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ABSTRACT 


A  survey  is  given  of  recently  developed  models  for  continuous  variate 
nonGaussian  time  series.  The  emphasis  is  on  marginally  specific  models  with 
given  correlation  structure.  Exponential,  Gamma,  Weibull,  Laplace,  Beta  and 
Mixed  Exponential  models  are  considered  for  the  marginal  distributions  of 
the  stationary  time  series.  Most  of  the  models  are  random  coefficient, 
additive  linear  models.  Some  discussion  of  the  meaning  of  autoregression 
and  linearity  is  given,  as  well  as  suggestions  for  higher-order  linear 


residual  analysis  for  nonGaussian  models. 
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INTRODUCTION 


Most  time  series  analysis  of  continuous  variate  discrete  time  parameter 
phenomena  is  based  on  the  simple,  linear,  autoregressive-moving  average 
processes  which  were  first  introduced  by  Yule  at  the  end  of  the  19th  century 
and  then  extended  by  many  authors.  Although  these  processes  are  not 
necessarily  defined  as  processes  in  Gaussian  variates,  it  is  simplest  to  use 
them  as  such  because  linear  operations  on  Gaussian  variates  preserves 
Gaussianity.  Again,  statistical  analyses  based  on  the  Gaussianity 
assumption  and  these  models  are  well  developed.  Consequently,  it  has  been 
the  practice  to  either  ignore  the  issue  of  the  marginal  distribution  of  the 
variates,  or  to  assume  that  the  variates  can  be  transformed  mildly  to 
Gaussianity  by  standard  methods. 

Unfortunately,  there  are  many  areas,  particularly  in  the  physical  sciences, 
where  nonGauss 1 ani ty  of  the  time-series  is  gross  and  is  itself  of  interest 
in  the  modelling  of  the  phenomenon  under  study.  The  nonGaussianity  may  be 
due  to  the  fact  that  the  phenomena  are  inherently  positive-valued,  or  are 
Ustributed  with  longer  or  shorter  tails  than  exhibited  by  Gaussian 
variates.  The  first  case  is  well  illustrated  in  river-flow  studies  (see 
••  .  4  .  .  Lawrance  and  Kottegoda,  1977),  as  well  a3  in  the  extensive  studies  of 
win  i  velocity  amplitudes  by  Oceanographers  and  Meteorologists  (see  e.g., 
Hr  .an,  Katz  and  Murphy,  1984).  The  second  case  occurs  when  the  North-South 
in  i  Kast-West  components  of  wind  velocities  are  studied  and  it  is  also 
.  uportant  in  the  study  of  acoustical  phenomena.  These  acoustical  phenomena 
nave  marginal  distributions  which  range  from  almost  uniform  distributions  to 
vt-ry  long-tailed  distributions  which  are  often  modeled  as  Laplace 
distributions. 

As  a  consequence,  there  has  been  an  accelerating  effort  during  the  last 
decade  to  derive  models  for  stationary  nonGaussian  continuous  variate  time 
series.  These  models  tend  to  imitate  the  linear  (Gaussian)  time  series  in 
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their  correlation  structure  and  use  various  standard  parametric  models  for 
marginal  distributions.  The  present  paper  will  survey  some  of  these  models. 
The  emphasis  is  on  models  which  are  (Lewis,  1980)  simple  and  flexible  in  the 
following  senses: 

(1)  The  models  should  be  specified  in  terms  of  easily  observed  and 
measured  quantifiers.  For  stationary  models  the  quantifiers 
should  typically  be: 

(a)  the  marginal  distribution; 

(b)  second-order  moments  (correlations);  and 

(c)  simplified  higher-order  moments  or  residuals. 

(ii)  The  models  should  be  parametrically  parsimonious  and 
parametrj.  :ally  simple. 

(iii)  The  models  should  be  easy  to  generate  on  computers,  i.e.  they 
should  be  structurally  simple,  like  the  usual  linear  models. 

(iv)  The  models  should  be  easy  to  fit  to  data,  both  formally  and 
informally. 

Note  especially  point  (i.c).  The  emphasis  in  deriving  the  models  described 
below  is  on  the  marginal  distribution  and  the  correlation  structure. 
However,  many  models  with,  say,  the  same  second-order  autoregressive 
structure  and  Exponential  marginal  distributions  are  now  known,  but  the 
sample  path  structures  of  the  various  models  can  be  vastly  different.  As  a 
consequence,  Lawrance  and  Lewis  (1985a,  1985b)  have  attempted  to  introduce  a 
residual  analysis  for  these  processes;  this  residual  analysis  will  be 
described  briefly  in  the  last  section. 

The  work  described  in  this  paper  is,  perforce,  mainly  that  of  the  author  and 
his  colleagues,  notably  A.  J.  Lawrance  and  E.  McKenzie;  not  suprisingly,  the 
work  fits  the  prescription  given  above.  The  state  of  this  work  can  be 
summarized  as  follows.  Many  models  with  first-order  autoregressive 
structure  of  some  sort  and  standard  parametric  marginal  distributions 
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(Exponential,  Gamma,  Mixed  Exponential,  Weibull,  Laplace,  Beta)  are  now 
known.  Extension  to  higher-order  autoregressive  structures  is  difficult, 
except  in  the  case  of  the  Exponential  marginal  distribution,  or  by  using  a 
rather  limited  random  indexing  device  (mixture  device)  due  to  Jacobs  and 
Lewis  (1983).  Mixed  autoregressive-moving  average  processes  can  be  obtained 
from  most  of  the  models,  because  they  have  (random  coefficient)  linear 
additive  structure.  Another  problem  is,  that  for  positive-valued  marginal 
distributions,  it  is  difficult  to  get  negative  correlation  in  simple  ways; 
this  may  or  may  not  be  a  serious  problem  in,  say,  hydrology  because  positive 
correlation  in  data  seems  most  common.  The  problem  of  negative  correlation 
is  intimately  tied  up  with  symmetry  of  the  marginal  distribution  and  is, 
therefore,  easy  to  obtain  for  the  models  which  will  be  described  for  Laplace 
marginals. 

Models  for  discrete  variate  time  series  are  described  by  McKenzie  (1985a). 


FIRST-ORDER  AUTOREGRESSIVE  PROCESSES 

A  natural  starting  point  for  nonGaussian  modelling  of  time  series  is  the 
linear  (constant  coefficient,  additive)  fir3t-order  autoregressive  process 
given  by 


Xn-  pXn_.j  ♦  En,  n-0,  ±1  ,  ±,  - ;  (1) 

this  is  a  first-order  stochastic  difference  equation  (Vervaat,  1979).  The 

E  's  are  assumed  to  be  independent  and  identically  distributed  (i.i.d.).  It 
n 

will  be  seen  later  that  it  is  perhaps  a  red  herring  to  start  with  this 
equation,  since  linearity  and  additivity  are  so  closely  tied  up  with 
Gaussianity.  However,  one  can  ask  whether  i.i.d.  innovation  sequences  { } 
exist  such  that  the  X  's  have  specified  nonGaussian  distributions.  Before 
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considering  this  in  the  Exponential  case,  it  is  necessary  to  consider  and 
clarify  three  commonly  occurring  concepts,  namely  autoregression,  linearity 
and  the  Markov  property. 

(1)  Autoregression,  Linearity  and  the  Markovian  Property. 

(i)  Autoregression. 

In  equation  (1)  it  is  clear  that  Xr  is  explicitly  autoregressed  (in  a 
linear,  additive  way)  on  X  ^  ,  but  autoregression  is  used  more  broadly  in 
time  series  analysis  and  is  an  important  idea  in  the  models  given  below. 
Thus,  Lawrance  and  Lewis  (1985b)  give  the  three  following  nested  definitions 
for  pth  order  autoregression: 


(a)  A  stationary  sequence  {X^}  is  said  to  be  explicitly  (pth  order) 
autoregressive  in  a  linear  additive  way  if  the  Xn'3  satisfy  the  equation 


°1Xn-1  +  a2Xn-1  *  •' 


+  a  X  ♦  E  , 
p  n-p  n 


where  the  En  are  i.i.d.  and  a^,  o^,***,  are  fixed  parameters.  Equation 
(2)  is  the  standard  linear  autoregressive  model,  AR(p). 


(b)  A  more  general  definition  of  autoregression  of  order  p  could  be  the 
linear  conditional  expectation  requirement  that 


E(Xn'»*lXn-r»**  Xn-2"“’’#,’V>,)" 

a1(Xn-l‘**)  +  a2(Xn-2_v)  +  +  °p(Xn-p'M)’  (3) 

where  u  is  the  (stationary)  mean  of  the  process.  Clearly  (2)  implies  (3), 
but  not  vice-versa. 
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(c)  A  further  and  weaker  definition  of  pth-order  autoregression  is  the 
requirement  that  the  autocorrelations  {p^}  of  the  process  { }  satisfy  the 
Yule-Walker  linear  difference  equations  of  order  p, 


p  ■  a. o  .  +  a„o  ~  +  •••  +  a  p 
vr  1Kr-1  2Hr-2  nHi»- 


P  r“P 


r  -  1,2, 


for  suitable  constants  a,,  a„,***,  a  and  with  p  -  p 

1  2*  p  Kr  -r 


Examples  of  processes  which  satisfy  these  definitions  will  be  given  below; 
in  particular,  it  will  be  seen  that  most  of  the  models  introduced  are 
linear,  additive  random  coefficient  models  which  satisfy  (3)  and/or  (4),  but 
not  (2). 


(ii)  Linearity. 


To  say  that  a  model  is  linear  will  be  taken  to  mean  that  the  process  {X^} 
satisfies  the  equation  (2).  Random  coefficient  models,  therefore,  are 
nonlinear,  although  some  authors  contend  that  they  are  linear  and  that 
nonlinearity  refers  only  to  the  case  where  powers  or  products  of  the  X  ^  , 
X  2,*»»,  E^  appear  in  the  defining  equation.  It  will  be  seen  later  that 
there  are  models  which  satisfy  the  third  form  of  autoregression,  but  are 
nonlinear  by  anyone's  definition  in  that  they  involve  products  and  have 
parameters  which  appear  as  powers. 


One  should  note  here,  too,  that  the  common  practice  of  transforming  time 
series  data,  so  that  it  has  (approximately)  a  Gaussian  marginal  distribution 
does  not  imply  that  the  transformed  process  will  have  linear  structure.  It 
is  possible  to  construct  models  which  have  Gaussian  marginal  distributions, 
but  which  are  nonlinear. 


6 


7/23/85 


(iii)  Markovian  Property. 


A  third  property  of  interest  is  the  Markovian  property,  which  we  will  only 
consider  in  the  first-order  case.  Thus,  a  process  { }  is  said  to  (first- 
order)  Markovian  if  the  conditional  density  of  Xn ,  given  the  past  of  the 
process,  satisfies 


(x  |X  , 
n1  n-1 


,Xn- 


2’ 


), 


(5) 


i.e.,  given  the  value  of  xn_1»  the  distribution  of  X^  does  not  depend  on 
Xn-2’  Xn-3’***’  Ttie  Pr,°cess  defined  by  (1)  is  clearly  of  this  form,  by 
construction,  and  there  are  two  important  consequences  of  this  property. 
The  first  is  that  one  can  write  down  the  joint  density  of  Xn,***,  X1  once  we 
know  the  marginal  density  and  the  conditional  density  in  (5).  Thus,  a 
likelihood  function  can  be  derived  from  which  one  can,  in  principle, 
estimate  parameters.  The  second  consequence  is  that  one  can,  for  a  given 
marginal  distribution,  construct  a  fir3t~order  Markovian  process  from  any 
bivariate  distribution  having  the  given  marginal  distribution  for  its  two 
marginal  distributions  (Linhart,  1970).  This  process  may  not  be 
autoregressive  in  any  of  the  above  senses,  although  it  will  possibly  have 
the  Yule-Walker  autoregression.  One  objection  to  this  procedure  is  that 
there  is  no  guidance  as  to  which  of  the  infinity  of,  say,  bivariate  Gamma 
distributions  to  use  in  the  construction.  The  other  objection  is  that 
without  an  explicit  simple  autoregressive  structure,  it  is  not  only  hard  to 
see  what  is  'going  on'  in  the  process,  but  it  is  also  difficult  to  extend 
the  process  to,  for  example,  moving  average  structures  and  simple  explicit 
multivariate  processes. 


(2)  First-Order  Processes  with  Exponential  Marginals. 


In  Equation  (1),  note  that  En  and  X  are,  by  definition,  independent. 

Thus  the  Laplace  transform  of  the  distribution  of  X  ,  ^  (s),  equals  the 

n 
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Laplace  transform  of  the  distribution  of  X  ,  times  that  of  E  .  If  the 
r  n- 1  n 

process  is  stationary,  solving  this  equation  gives  the  equation 

4>e(s)  -  4>x( s ) ps ) .  (6) 

In  (6),  it  is  assumed  that  a  solution  exists  for  a  given  marginal  distribu¬ 
tion  of  X.  Gaver  and  Lewis  (1980)  showed  that  for  X  Exponential  ( X )  ,  E  is 
zero  with  probability  p  and  Exponential(X)  with  probability  1-p.  Note  that 
this  EAR ( 1 )  process  -  Exponential  autoregressi ve  of  order  one  -  is  a  linear 
process.  What  is  different  is  that  the  innovation  random  variable,  E^,  is 
not  absolutely  continuous,  since  its  distribution  has  a  jump  at  zero.  Thus, 
Mallows  (1967)  result  that  linear  processes  must  have  Gaussian  marginal 
distributions  as  p  approaches  one  does  not  hold.  However,  the  process  is 
autoregressive  in  all  three  senses.  The  last  sense  follows,  because  for  the 
EAR( 1 )  model  p(r)=pr  for  r-1,2,...,  which  is  the  solution  of  the  first-order 
Yule-Walker  equation.  The  process  may  also  be  written  as  a  random 
coefficient  model 


pX  ♦  I  Z 
y  n-1  n 


n  n' 


(7) 


where  the  Zn's  are  i.i.d.  Exponentials  and  the  i.i.d.  indicator  random 

variables  I  have  P{I  =0}  =  1  — P { I  =1 }  »  p. 
n  n  n 

A  problem  with  the  EAR( 1 )  model  is  that  the  innovation  random  variable  takes 
on  the  value  zero  with  positive  probability.  This  makes  the  process 
'defective'  in  the  3ense  that  when  In»0,  then  Xn»pXn-1  and  the  parameter  p 
can  be  estimated  exactly  in  long  enough  series  (Gaver  and  Lewis  (1980)). 
Note,  too,  that  sample  paths  have  'runs  down'.  Although  this  bothers  people 
who  are  accustomed  to  more  conventional  looking  time  series,  it  is  not 
necessarily  bad  in  hydrological  contexts,  i.e.  river  run-offs. 
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Now  note  that  in  (7),  we  can  switch  X  ,  and  Z  to  get  another  Exponential 

n- 1  n 

autoregressive  process  of  order  one  (in  the  sense  of  (l.i.b)  and  (l.i.c)), 
which  is  not  defective,  exhibits  ’runs-up',  and  is  regenerative.  The 
switching  which  produced  this  TEAR(1)  process  led  Lawrance  and  Lewis  (1981a) 
to  define  the  broad,  two  parameter  Exponential  autoregressive  (in  the  sense 
of  (l.i.b)  and  (l.i.c))  process  NEAR(1) 


X 

n 


K  X  ♦  I  Z  , 
n  n-1  n  n 


(8) 


where  0S8S1 ,  P{K  =6}  -  1 -P { K  =0}  =  a  and  P{I  -1}  =  1  -P { I  -(1-a)B}  =  6,  with 
n  n  N  n 

6  =■  ( 1 -6 )  /  { 1  -  ( 1 -a )  6 )  .  Also,  the  i.i.d.  Exponential  sequence  {Z^},  the 

i.i.d.  {K^}  sequence  and  the  i.i.d.  {1^}  sequence  are  independent  of  each 

other,  and  K  and  I  are  independent  of  the  X  's  for  n-1,  n-2,«»». 
n  n  n 


This  NEAR(  1  )  process  includes  the  EAR(1)  process  (ot=1  )  and  the  TEAR(1) 

process  (6-1)  given  at  (7),  and  can  exhibit  a  wide  range  of  sample  path 

I  r*  I 

behavior;  also  p(r)  »  (aB)1  The  second  form  of  autoregression  follows 

from  the  result  that  E(X  |X  ,=x)  =  af}x  +  (  1 -aB)  ,  where  we  assume  that  the 

n  1  n-1 

parameter  of  the  Exponential  distribution,  X,  equals  one. 


Two  other  important  Exponential  processes  which  will  appear  as  special  cases 
of  Gamma  models  in  the  next  section  are  the  Product  Autoregression  model  of 
McKenzie  (1982)  and  the  Beta-Gamma  process  of  Lewis  (1981).  We  give,  now, 
several  other  models  which  are  derived  from  special  properties  of  the 
Exponential  distribution. 


Perhaps  the  most  important  of  the  Exponential  processes  beyond  the  NEAR(1) 
process  is  the  Tavares  (1977,  1980a,  1980b)  process.  Like  most  of  the 
simple  models,  it  exploits  probabilistic  structures  which  combine  two 
independent  Exponential  random  variables  into  a  third  Exponential  random 
variable.  Here  the  combination  is  that  the  minimum  of  two  independent 
Exponential  random  variables  is  Exponential.  Thus,  if  as  before,  { } 
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Lewis  (1981)  extended  (13)  to  the  very  simple  bivariate  Gamma  process 

»  t» 

(Xn,Xn)  where,  for  n  -  0,±1,±2,...f 

X^  -  A^(k-q',q')X^_1  +  B^(q * ,k-q* )Gn(k , 6) .  (27) 

X"  »  A"(k-q",q’’)X”_1  +  B”  (q"  ,k-q"  )Gn(k  ,  8)  .  (28) 

In  these  equations,  {A^,A^}  and  {B^.B^J}  are  mutual*y  independent  i.i.d. 
sequences  of  bivariate  Beta  variables  which,  for  now,  are  assumed  to  be 
independent  pairs.  This  model  may  be  thought  of  as  giving  responses  at  two 
different  locations  with  the  responses  being  driven  by  a  common  driving 
effect  represented  by  the  common  error  term  En«Gn(k,B).  The  random 
coefficients  represent  local  modifying  effects  and  the  autoregressions  are 
local  dependencies.  A  problem  with  this  (too)  simple  model  is  that  there 
are  only  two  free  parameters,  q'and  q"  ,  for  the  dependency  structure,  so 
that  the  autocorrelation  fixes  the  crosscorrelation. 

There  are  many  ways  to  extend  this  model.  First,  instead  of  a  common  error 
term,  Gn(k,B),  one  could  have  a  pair  of  dependent  error  terms  G^(k,B)  and 
G^(k,B)  which  are  a  bivariate  Gamma  pair.  Also,  one  might  use  different 
lags  in  the  error  terms  to  represent  physical  delays.  Again,  it  is  possible 
to  cro33-couple  the  processes  by  switching  the  lagged  terms  X^_1  and  X^_1  in 
(27)  and  (28)  and  to  make  the  random  coefficients  dependent.  Gaver  and 
Lewis  (1980)  used  this  cross-coupling  and  negatively  correlated  random  error 
terms  to  obtain  negative  correlation  in  the  Gamma  marginal  processes. 

For  further  details  and  other  models,  see  Lewis  and  Shedler  (1979),  Jacobs 
(1978,  1980)  and  Dewald  and  Lewis  (1985b). 
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If  we  replace  Xn-1  in  (13)  by  G  we  have  a  moving  average  Gamma  model 

whose  correlations  are  zero,  except  at  lag  one  and  are  bounded  by  zero  and 
one-quarter.  But,  it  can  be  shown  (Hugus,  1982)  that  the  attainable  range 
for  p ( 1 )  in  random  coefficient  moving  average  processes  is  minus  one  half  to 
plus  one  half,  as  with  the  normal  theory  linear  MA(1)  process.  A  different 
structure  achieves  the  maximum  range  of  positive  correlations  for  the  Beta- 
Gamma  first-order  moving  average  model  (Lewis,  McKenzie  and  Hugus,  1985): 

Xn(6,k)  °  GntB,k/(1+<fr)}  +  Bn{k$/(1+<f>)  ,k(1 -<{>)/(  1 +<(>)  }Gn-1  U,k/(1+<|>)}.  (26) 

The  lag-one  serial  correlation  is  p( 1 )=$/( 1 +$) ,  which  has  its  maximum  value 

of  one  half  when  $=1/2.  For  $=0  or  1,  the  process  is  a  sequence  of  i.i.d. 

Gamma(B,k)  variables.  Surprisingly  enough,  the  joint  Laplace  transform  for 

X  and  X  ,  is  given  by  (13),  so  that  the  Beta-Gamma  autoregressive  and 
n  n  - 1 

moving  average  processes  are  very  much  analogous  to  the  linear  Gaussian 
processes.  Like  the  Gaussian  process,  these  Gamma  moving  average  and 
autoregressive  processes  are  time  reversible. 

Because  moving  average  and  mixed  moving  average  processes  are  not  Markovian, 
the  problem  of  parameter  estimation  in  these  processes  in  the  nonGaussian 
case  is  difficult.  Nevertheless,  their  structures  may  be  realistic  for 
modelling  some  physical  phenomena.  The  model  (26)  can  be  extended  to 
qth-order  moving  average  structures  (Lewis,  McKenzie  and  Hugus,  1985). 

MULTIVARIATE  MODELS 

There  i3  a  clear  need  in  hydrology  and  other  physical  fields  for  multi¬ 
variate  processes  and  some  such  extensions  of  the  simple  models  we  have 
discussed  in  previous  sections  have  been  made.  By  way  of  example  of  the 
results  which  can  be  obtained  as  extensions  of  the  simple  random  coefficient 
models  discussed  in  the  first  part  of  this  paper,  consider  again  the  Beta- 
Gamma  process. 
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slightly  more  complicated  for  Uniform(0,1)  variates;  one  substitutes  1-U  for 
U. 

In  other  cases  of  non-symmetric  marginal  distributions,  one  solution  is  to 
use  the  antithetic  variate  X’  in  place  of  X  in  the  defining  equations,  where 

X*  -  F~ 1 ( 1  -  FX(X))  (25) 

and  for  the  symmetric  (about  zero)  case  X'«-X.  Also,  in  the  Uniform(0,1) 
case  U'-l-U.  As  an  example,  consider  the  Exponential  case  and  substitute 
for  Xr  in  the  defining  equation  (20)  for  the  NEAR(2)  process  the 
antithetic  of  xn_-|  »  namely  X'_.j-  -log{  1  -exp(-Xn_1  ) } .  Then  one  has  a  process 
which  can  exhibit  the  whole  range  of  correlations  for  Exponential  variables. 
However,  even  though  the  process  is  explicitly  'autoregressive',  it  is  not 
autoregressive  in  any  of  the  three  senses  given  above.  It  is,  however, 
Markovian,  but  is  probably  not  simple.  Even  the  correlations,  p(r),  are 
difficult  to  calculate. 

An  alternative  scheme  for  obtaining  negative  correlation  in  time  series  was 
given  in  Gaver  and  Lewis  (1980).  This  consists  of  cros3-coupl ing  two 
processes.  Details  are  not  given  here.  In  the  symmetric  case  it  reduces  to 
the  usual  process.  The  process  is,  however,  not  in  general  Markovian. 

MIXED  AUTOREGRESSIVE-MOVING  AVERAGE  MODELS 

Several  authors  have  extended  the  above  autoregr essi ve  models  to  moving 
average  and  mixed  autoregressive-moving  average  models  for  various  marginal 
distributions.  We  refer  the  reader  to  Lawrance  and  Lewis  (1977),  Jacobs  and 
Lewis  (1977),  Lawrance  and  Lewis  (1980),  McKenzie  (1981)  and  Lewis,  McKenzie 
and  Hugus  (1985).  It  is  particularly  easy  to  extend  random  coefficient 
models  to  moving  average  structures  and  we  discuss  here,  by  way  of 
illustration,  only  the  Beta-Gamma  model  given  at  (13). 
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also  has  short-term  (first-order)  dependence.  Out  of  the  context  of 
Exponential  marginals,  the  random  indexing  scheme  can  be  used  with  any 
first-order  autoregressive  scheme  to  obtain  a  similar  effect.  In  a  somewhat 
different  but  related  vein,  Fernandez  and  Salas  (1985)  have  extended  the 
autoregressive  Gamma  process  to  the  case  of  periodic  parameters;  this  is  an 
extension  to  the  nonGaussian  case  of  the  so-called  "Thomas-Fiering  model", 
although  the  model  is  actually  due  to  Hannan  (1955). 

We  note,  too,  that  it  is  quite  simple  to  include  deterministic  periodic  and 
seasonal  trends  in  the  models  for  positive  random  variables.  In  particular, 
the  mean  in  the  Gamma  random  variable  is  multiplicative  and  can  easily  be 
replaced  by  a  time-varying  mean.  Log-linear  models  for  this  mean  are 
appropriate,  since  they  retain  the  positivity.  In  particular,  Hugus  (1982) 
fitted  an  exponential  sine  to  fifteen  years  of  three-hourly  wind  amplitude 
readings  at  ship  PAPA  in  the  Gulf  of  Alaska.  The  exponential  sine  included 
six-hourly,  six-monthly  and  yearly  terms.  The  residual  process  was  fitted 
by  a  Beta-Gamma  process  with  p(1)«0.88. 

NEGATIVE  CORRELATION 

It  would  be  useful  to  have  time  series  models  for  nonGaussian  data  which  can 
accomodate  the  full  range  of  attainable  correlations,  although  we  note  that 
the  usual  range  of  -ISpSI  for  Gaussian  models  is  not  attainable  (Moran, 
1967)  for  pos i t i ve- va 1 ued  variables.  Thus,  for  exponential  random 
variables,  the  lowest  value  is  — 0 . 6U 49 .  Attainment  of  negative  correlation 
in  processes  in  a  simple  way  is  intimately  tied  up  with  symmetry  of  the 
marginal  distribution.  This  is  because,  when  the  random  variable  X  is 
centered  at  zero,  then  -X  has,  by  the  definition  of  symmetry,  the  same 
distribution  as  X.  Thus,  in  the  extension  of  the  NEAR(2)  models  to  Laplace 
variables  (Dewald  and  Lewis,  1985a),  the  whole  range  of  correlations, 
-1  <  p  <  1,  is  attained  by  substituting  -X  for  X.  The  situation  is  only 
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»  11 

where  the  i.i.d.  sequences  {L  }  and  {K  ,K  }  are  assumed  to  be  mutually 

n  n  n 

independent  and  independent  of  the  i.i.d.  Exponential  sequence  {E^}  and  of 
Xn-1'  Xn-2  *  *  *  ’  *  0  *  BT62  *  and  a1  2  °*  °2  2  °’  a1  +  °2  *  1  With 


1 

w.p. 

1  -  p2  -  p. 

L  - 
n 

h2 

w.p. 

p2  3. 

n  »  0, ±1 , ±2, • • • , 

(22) 

b3 

w.p. 

p3 

f  n 

|  (1.0) 

w.p. 

a1 

®2 

1  '  a1  -  °2 

(K  ,K)  “ 
n  n 

(0,1) 

[  (0,0) 

w.p. 

W.p. 

n  -  0 ,  ±1  ,  ±2 ,  •  •  • . 

(23) 

parameters 

pr  p2 

•  b1 

and  b2  are  complicated  functions 

of  the  four 

parameters  of  the  process  and  are  not  given  here.  For  o_-0,  we  get  the 

^  I 

NEAR( 1 )  process  and  there  are  several  cases  which  give  independent  X  s. 
Moreover,  the  correlations,  which  are  positive-valued,  satisfy  the  Yule- 
Walker  equations  and  we  have  explicitly 

p(1)  -  (a,j B.| ) /( 1  -  and  +  (a262^  ‘  (2*0 

It  is  fairly  certain  that  this  structure  can  be  extended  to  higher-order 
autoregressions,  but  it  is  not  at  all  clear  that  explicit  expressions  for 
the  parameters  can  be  obtained.  However,  using  the  mixture  scheme  given 
above,  this  four-parameter  second-order  process  can  be  extended  to  higher- 
orders  quite  simply  (Lawrance  and  Lewis,  1985a).  One  can  obtain,  for 
instance,  a  four-parameter  Hh-order  autoregressive  process  and  this  is 
probably  sufficient  for  most  purposes. 

(3)  Seasonal  and  Stuttered  Models. 

The  autoregression  on  *n_2  in  (21)  can  be  replaced  by  autoregression  on, 
say,  X  to  give  a  stationary  (non-deterministic)  seasonal  model,  which 

n-3 
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Xn  -  AX  Q  ♦  B  Z,  n  »  0, ±1 , ±2 ,  •  •  • .  (20) 

n  n  n-S  n  n 
n 

The  assumption  is  that  the  process  is  stationary;  the  scheme  works  because  a 
mixture  of  random  variables  with  identically  distributed  marginal 
distributions  has  that  same  marginal  distribution,  even  if  the  random 
variables  are  dependent.  Moreover,  it  is  easily  verified  that  the 
correlations  p(r)  satisfy  the  Yule-Walker  equation  ( *4 )  with 

Oj=*TjE(An),  j-1 ,  •••,?. 

Drawbacks  to  this  scheme,  as  to  any  scheme  with  this  breadth,  can  be  seen  to 
occur  for  two  reasons.  One  is  that  the  a.’s  in  the  Yule-Walker  equations 

J 

are  limited  in  range,  since  the  Tj's  are  probabilities  and  the  E(An)  will 
have  a  limited  range  in  specific  cases.  Thus,  the  range  of  attainable 
correlations  will  be  limited  in  comparison  with,  say,  the  attainable  range 
of  correlations  for  the  AR(p)  process.  The  second  drawback  comes  from  the 
fact  that  runs  of  identical  values  are  possible  in  the  sample  path  of  the 
process,  since  there  is  a  small  probability  that,  for  example,  X^,  xn+1  »  and 
X  .  may  have  the  value  same  value  X  ,  if  B  can  take  on  the  value  zero. 
Nevertheless,  this  random  indexing  scheme  does  supply  a  limited  solution  to 
a  very  difficult  and  important  problem. 

(2)  The  Exponential  NEAR(2)  MODEL. 

A  broad  extension  of  the  NEAR(1)  to  second-order  autoregression  (in  the 
sense  of  (l.i.b)  and  1.1. c))  has  been  given  by  Lawrance  (1980)  and  Lawrance 
and  Lewis  (1985a).  This  process  is  denoted  NEAR( 2)  and  has  four  parameters. 
Also,  despite  its  restriction  to  an  Exponential  marginal  distribution,  the 
structure  which  gives  the  process  is  important  in  extending  Exponential 
processes  in  general. 

Thus,  let  the  stationary  process  {Xn}  be  defined  by  the  random  coefficient 
stochastic  difference  equation 
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Note  that  the  resulting  process  is  not  simple  and  that  it  is  unique.  This 
contrasts  to  the  fact  which  we  have  seen  above,  that  there  exist  many 
processes  with  the  same  marginal  distributions  and  that  this  may  be 
desirable  in  the  modelling  of  physical  phenomena  such  as  those  that  occur  in 
hydrology. 


HIGHER-ORDER  AUTOREGRESSIVE  PROCESSES 

In  many  applications  there  is  a  need  for  higher-order  nonGaussian 
autoregressive  processes  which  mimic  the  AR(p)  process  given  at  (2). 
However,  the  analog  of  the  simple  equation  (6)  is  not  available  for  p>1 .  In 
fact,  no  direct  solutions  exist  to  equation  (2),  other  than  for  Gaussian 
processes.  We  describe  now  several  schemes  which  have  been  derived, 
starting  with  a  very  general  mixture  scheme  and  then  describing  the  NEAR( 2) 
process  of  Lawrance  and  Lewis  (1985a). 

(1)  Random  Indexing  (mixture  models). 

We  note  that  the  first-order  autoregressive  models  given  above  can  be 
written  for  the  most  part  as  random  coefficient  models  of  the  form 

Xn  ‘  AnXn-1  *  Vn’  n  -  0.±1 , ,2,  (19) 

with  the  usual  independence  conditions  on  the  random  coefficient  sequences 

An  and  Bn  and  the  innovation  sequence  Z n.  Note,  however,  that  for  given  n, 

the  A  and  the  B  do  not  have  to  be  independent.  This  is  the  case  for  the 
n  n 

Beta  model  given  at  (17)  above.  Now  the  random  indexing  scheme  (Jacobs  and 
Lewis,  1983)  is  to  replace  the  index  n-1  in  (19)  by  n-Sn,  where  SR  is  a 
discrete  valued  random  variable  on  1,...,p  with  probabilities  and 

the  Sn's  are  assumed  to  be  i.i.d.  Thus,  we  have 
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The  Beta-Beta  transform  states  that  the  product  of  two  independent  Beta 
random  variables  is  a  Beta  random  variable,  so  that  Beta(a,6)  •  Beta(a+B,Y) 
-  Beta(a,8+Y).  Then  the  PBAR(1)  model  is  given  by 

X  -  1  -  A  ( 1  -  B  X  .)  n  -  1 ,2,3, *•*.  (17) 
n  n  n  n-1 

where  { An }  and  {B^}  are  independent  sequences  of  i.i.d.  Beta(B.a-p)  and 
Beta(p.a-p)  random  variables.  The  single  structural  parameter  in  this 
scheme,  p,  determines  the  correlation  structure  of  the  process,  .nich  is 

Px(r)  »  {pB/a(a+S-p)}r  -  pr,  r  -  0,1,2,***;  0  S  p  <  a.  (18) 

Note  that  in  this  Beta  process,  the  parameters  a  and  B  determine  the 
marginal  distribution  of  the  Xn's,  and  p  can  be  freely  chosen  in  the  range 
0  £  p  <  a  to  determine  the  correlation. 

An  important  special  case  occurs  when  a-B-1  and  the  marginal  distribution  i3 
Uniform(0, 1 ) .  This  process  is  an  additive  random  coefficient  process  in 
U ni f orm (0 , 1 )  variables.  Multiplicative  Unlform(0,1)  processes  may  be 
obtained,  for  instance,  by  negative  exponentiation  of  the  NEAR(1)  process 
given  at  (8).  The  properties  of  the  resulting  two-parameter  process  have 
not  yet  been  investigated. 

One  should  note  here  that  the  random  coefficient  approach  is  not  the  only 
way  to  generate  a  process  with  both  a  specified  correlation  structure  and 
marginal  distribution.  There  is  another  approach  in  the  Engineering 
literature  which  is  to  start  with  a  Gaussian  ARMA(p,q)  process,  filter  it, 
transform  marginally  using  a  probability  integral  transform  to  a 
Uniform(0, 1 )  marginal  and  then,  via  an  inverse  probability  integral 
transform,  create  the  desired  marginal  distribution.  The  filter  is  chosen 
to  give,  if  possible,  the  desired  correlation  structure.  Solutions  are 
known,  for  example,  for  an  Exponential  marginal  distribution  (Sondhi,  1983). 
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Another  distribution  which  may  be  useful  for  modelling  phenomena  such  as 

North-South  wind  velocity  components  which,  unlike  the  phenomena  we  have 

considered  before,  are  not  inherently  positive  valued,  is  the  symmetric 

2  -£ 

£-Laplace  distribution.  Its  characteristic  function  is  $x(u>)  -  ( 1  +  u>  )  , 

which  for  £-1  is  that  of  the  Laplace  (or  double-Exponential )  distribution. 
For  £  large,  this  is  approximately  a  Gaussian  distribution.  For  £  small,  it 
is  peaked  at  x-0  and  when  ££  0.5,  the  density  is  unbounded  at  x  -  0.  For 
the  Laplace  distribution,  the  NEAR(1)  structure  (and  the  NEAR(2)  structure 
given  below)  go  through  with  analagous  formulas  to  those  for  the  Exponential 
case  (Dewald  and  Lewis,  1985a)  and  there  is  a  square-root  Beta  £-Laplace 
process  which  is  the  analog  of  the  Beta-Gamma  process  (Dewald,  Lewis  and 
McKenzie,  1985). 

The  Weibull  distribution,  as  well  as  other  extreme-value  distributions,  is 
widely  used  to  broaden  the  Exponential  assumption  for  the  marginal 
distributions  of  stationary  time  series.  Note  that  it  is  not  infinitely 
divisible  and,  therefore,  is  not  type-L,  so  that  there  is  no  solution  to  the 
equation  (1).  However,  a  Weibull-distributed  random  variable  is  a  power-law 
transform  of  an  Exponentially  distributed  random  variable,  so  that  the 
minimum  structure  (9)  and  the  PAR(1)  structure  (12)  give  relatively  simple 
first-order  autoregressive  processes. 

Situations  do  occur  in  which  processes  are  required  with  marginal 
distributions  which  are  bounded  below  and  above.  One  might,  for  instance, 
be  Interested  in  modelling  a  sequence  of  probabilities,  say  the  probability 
of  overflow  at  a  dam  on  successive  days.  For  this  case,  the  Beta 
distribution  mentioned  above  provides  a  broad,  two-parameter  distribution 
model  which  is  widely  used.  McKenzie  (1985b)  has  derived  an  autoregressive 
process  for  Beta  random  variables  using  the  Beta-Beta  transform.  Thus,  let 
Beta(a,B)  denote  a  Beta  random  variable  with  probability  density  function 


a-1 , , 
x  (1  - 

B(a,B) 


0  <  x  <  1 ;  a,B  >  0. 
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restricted  ranges  of  the  parameter  p.  Thus,  the  mixed  Exponential  (or 
hyper-Exponential )  distribution,  with  probability  density  function 


-X  ^  x  -X^x 

fx(x)  -  n^e  +  *2X2e  ’  0  *  ir1,1T2  S  1;  X1,X2  1  0;  1W“1’  (15) 

which  is  used  to  model  phenomena  which  are  more  skewed  than  the  Exponential 
distribution,  is  not  type-L.  However,  Gaver  and  Lewis  (1980)  gave  some 
sufficient  conditions  for  a  solution  to  exist  and  Lawrance  (1980)  gave 
necessary  and  sufficient  conditions  on  the  parameters  fj,  k,  p  for  the 
solution  to  exist.  The  utility  of  these  results  are  not  clear,  since  the 
Beta-Gamma  process  provides  an  alternative  for  skewed  data  which  has,  in 
particular,  a  much  simpler  estimation  solution.  There  are,  however, 
differences  between  the  two  distributions  which  might  be  important  in 
modelling. 

(5)  Ad-hoc  Methods  for  First-order  Processes. 

Several  of  the  more  useful  marginal  distributions  which  have  been  used  for 
modelling  marginal  distributions  in  the  physical  sciences  have  associated 
first-order  processes.  These  processes  are  generally  multiplicative  or 
additive  random  coefficient  models,  which  again  illustrates  that  the  linear 
model  (1)  may  be  a  false  starting  point.  The  processes  are  generally 
autoregressive  in  one  of  the  senses  given  above.  We  consider  these 
processes  briefly  here  for  Laplace,  t-Laplace,  mixed  Exponential,  Weibull 
and  extreme-value  distributions. 

Lawrance  and  Lewis  (1982)  have  shown  that  the  switched  structure  given  at 
(7)  has  a  solution  when  the  Xn  process  is  required  to  have  the  mixed 
Exponential  distribution  whose  density  is  given  at  (15).  This  includes  the 
zero  jump  Exponential  distribution  (1/X^O),  which  might  be  useful  for 
modelling  winds  in  areas  where  there  is  a  positive  probability  of  having  an 
amplitude  of  zero,  i.e.,  being  in  the  Doldrums. 
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This  Beta-Gamma  process  is  a  remarkably  'smooth'  process  in  at  least  two 
ways.  First,  the  conditional  density  of  Xn  given  X  ,j  is  continuous  and, 
therefore,  it  is  relatively  simple  to  get  maximum  likelihood  estimates  for 
the  parameters  p,  k  and  q  (Hugus,  1982).  Secondly,  let  p— ( 1  — q/k ) .  Then  the 
joint  Laplace  transform  of  Xn  and  X  ,j  is  given  by  (Lewis,  McKenzie  and 
Hugus,  1985) 

♦  (s1  ,s2)  -  {(1  ♦  Sl)(1  ♦  s2)fk(1"p)(1  ♦  s,  ♦  s2fkp.  (1H) 

This  result  shows,  first  of  all,  that  the  process  is  time  reversible,  since 

s1  and  s2  can  be  interchanged  in  the  equation,  and  secondly,  that  both  the 

regression  of  X  on  X  ,  and  the  regression  of  X  ,  on  X  are  linear.  In 
n  n-1  n-1  n 

these  respects  the  Beta  Gamma  process  is  much  like  the  Gaussian  AR(1) 
process.  However,  in  modelling  physical  phenomena  such  as  river-flows,  this 
smoothness  may  be  a  handicap.  Thus,  it  is  not  possible  to  model  'runs-down' 
in  data,  since  for  fixed  k  and  p  (marginal  distribution),  the  structural 
parameter  q  (or  p)  changes  the  correlation,  but  not  the  sample  path 
behavior.  An  extension  of  the  process  to  a  broader  structure  is  given  in 
Lawrance  and  Lewis  (1981);  it  combines  the  GAR(  1 )  process  and  the  BGAR(  1 ) 
process. 

(4)  Other  Linear  Models. 

Other  solutions  to  the  first-order,  linear,  stochastic  difference  equation 
(1),  known  as  type-L  distributions,  are  known  (Shanbag  and  Sreehari ,  1977; 
Thorln,  1977a,  1977b),  but  generally  do  not  give  simple,  tractable 
solutions.  A  case  in  point  is  the  log-Gamma  distribution.  Results  from 
McKenzie  (1982)  for  the  P AR ( 1 )  process  say  that  there  is  an  innovation 
random  variable  in  this  case,  but  it  is  not  easy  to  even  generate  it,  except 
when  the  Xn's  have  a  log-Exponential  distribution.  Another  problem  with  use 
of  the  linear  equation  (1)  is  that  useful  results  may  be  obtained  for 
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the  sense  (l.i.a)  or  the  sense  (1.1. b)  above;  however,  since  p(r)-pr, 
r-1,2,***,  It  is  autoregressive  in  the  third  sense.  It  is,  of  course,  very 
nonlinear,  in  the  usual  sense  of  that  term. 

The  last  Gamma  process  we  introduce  is  the  Beta-Gamma  process  (Lewis,  1981) 
which  has  been  detailed  in  Lewis,  McKenzie  and  Hugus  (1985).  This  is  a 
simple  and  very  broad  process  which,  in  some  ways,  is  an  analog  of  the 
Gaussian  AR(1)  process.  It  is  based  on  the  Beta-Gamma  transformation 
(Lewis,  1983)  which  is  as  follows.  Let  X  be  a  Gamma(m+n,B)  variate  and  let 
Beta(m,n)  be  an  independent  Beta  variate  with  parameters  m£0  and  n£0;  then 
Beta(m,n)«X  is  a  Gamma (m ,  £S )  variate.  Using  this  result,  we  can  construct 
the  Beta-Gamma  first-order  autoregressive  process,  BGAR(I),  as  follows: 

Let 


An,  n-1,2,»»»,  be  i.i.d.  Beta(k-q,q)  random  variables  with  q<k; 

Bn>  n»1,2,***,  be  i.i.d.  Beta(q.k-q)  random  variables,  independent 

of  the  A  's; 
n 

Gn,  n-0, !,•••,  be  an  i.i.d.  sequence  of  Gamma(k,B)  innovation 

random  variables  and  let  Xq=Gq;  the  Gn  sequence  is  independent  of 
the  Anand  the  B^  sequence. 

Then 


X  -  A  X  +  B  G  ,  n-1 ,2, •••,  (13) 

n  n  n-1  n  n’  ’ 

p 

is  a  stationary  sequence  of  Gamma(k,B)  variates  with  p(r)«(1-q/k)  , 
r-1,2,»*».  The  process  is  a  random  coefficient  first-order  autoregressive 
process,  and  as  such,  is  autoregressi ve  in  the  second  two  senses  given 
above.  The  process  is  also  Markovian.  Note  that  in  (13)  the  term  BnGn  can 
be  written  as  a  Gamma(k-q,B)  variate;  the  form  (13)  is  convenient  because  it 
expresses  the  process,  {X^},  33  an  autoregression  on  i.i.d.  Gamma(k,B) 
variates . 
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from  small  positive  values  to  large  values,  the  random  variable  changes  from 
a  highly  skewed  variable  whose  density  is  infinite  at  zero,  to  the 
Exponential  (k-1 ) ,  to  a  Gaussian  (k>50).  The  density  is  given  by 

fx(x)  -  Bkxk-1e‘x6/r(k)  B>0;  k>0  ;  x*0.  (10) 

Note  that  the  mean,  u  -  k/8,  is  multiplicative  and  the  Gamma  random 

variable,  denoted  by  G(8,k)  or  G(p,k)  may  be  written  as,  uG(k,k)  or  pG(1,k), 

k 

respectively.  The  associated  Laplace  transform  is  $x(s)-{B/(8+s)}  and  (6) 
yields,  for  the  linear  autoregressive  process  (1), 

#E(s)  -  (p  ♦  (1  -  p)B/(8  ♦  s)}k,  k>0 ;  B>0,  (11) 

which  (Gaver  and  Lewis,  1980)  is  the  Laplace  transform  of  a  proper  random 
variable.  The  linear,  first-order  autoregressive  process  (1)  with  this 
innovation  random  variable  is  called  the  Gamma  autoregressive  process  of 
order  one,  GAR(  1 )  .  This  process  actually  was  used  in  hydrology  (Bernier, 
1970  )  many  years  before  its  rediscovery;  unfortunately,  although  it 
includes  and  broadens  the  EAR(1)  process,  it  too  is  defective.  Thus,  E  is 

k 

zero  with  probability  p  ,  which  is  very  serious  if  k<1  (very  skewed  marginal 
distribution).  Also  $E(s)  cannot  be  explicitly  inverted  unless  k  is  an 
integer,  although  Lawrance  (1982)  and  McKenzie  (1985c)  have  found  methods 
for  generating  random  variables  with  this  Laplace  transform. 


McKenzie  (1982)  introduced  a  product  autoregression  process  of  order  one, 
called  PAR(1),  of  the  form 


.E  , 
n-1  n’ 


0  S  p  <  1, 


but,  although  E exists  for  all  values  of  the  Gamma  parameter  k,  it  is  only 
possible  to  generate  it  for  the  Exponential  case  (k-1).  Note  that  this 
process,  since  it  is  multiplicative  in  structure,  is  not  autoregressive  in 
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denotes  a  sequence  of  i.i.d.  Exponential  (A)  random  variables,  the  minimum 
process 


Xn  -  min(Xn_1/p,  Zn),  (9) 

will  have  Exponential  marginals  and  correlation  structure  p(r)«pr, 
r=0,1,***.  Thus,  the  process  is  autoregressive  in  the  third  sense  given 
above,  but  the  autoregression  of  Xn  on  x  1t  while  explicit,  is  not  linear, 
even  in  a  random  coefficient  sense.  Nor  is  the  conditional  expectation  of 
Xn»  given  X  ^  ,  linear.  Thus,  the  first  two  forms  of  autoregression  do  not 
hold.  What  is  remarkable  about  this  process  is  that  it  is  a  time  reversed 
version  of  the  EAR ( 1 )  process  given  at  (1).  This  result  is  due  to  Chernick, 
Daley  and  Littlejohn  (1983).  In  particular  it  shows  that  the  process  is 
defective.  DeHeuvels  (1983,1984)  has  exploited  this  minimum  structure  even 
further  and  has  tried  to  show  that  all  stationary  Exponential  processes  can 
be  represented  as  infinite  moving  minima.  However,  this  generalized  minimum 
structure  does  not  admit  Exponential  processes  with  negative  correlation  and 
is  to  some  extent  defective. 

Many  other  first-order  processes  in  Exponential  random  variables  are  now 
known.  For  instance,  one  could  add  two  independent  Gaussian  AR(1)  processes 
to  obtain  an  Exponential  process  with  geometrically  decaying  correlations. 
Suprisingly,  this  process,  while  not  explicitly  autoregressive  and  not 
having  an  explicit  structure,  has  been  shown  to  be  Markovian.  Another 
interesting  process  which  arises  in  the  context  of  engineering  geology  has 
been  given  by  McCullagh  (1983).  Again,  negative  correlation  is  not 
possible . 

(3)  First-Order  Processes  with  Gamma  Marginals. 

The  two-parameter  Gamma  distribution  is  a  widely  used  model  for  the  marginal 
distribution  of  many  physical  time  series.  As  the  shape  parameter  k  changes 
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TIME  REVERSIBILITY,  HIGHER-ORDER  MOMENTS  AND  RESIDUAL  ANALYSIS 


A  recurrent  theme  in  the  models  which  have  been  described  i3  that  of  time 
reversibility  and  directionality.  Gaussian  linear  models  given  by  (2),  with 
extensions  to  mixed  autoregressive-moving  average  structure,  are  time 
reversible  and  are  the  only  dependent  linear  models  with  this  property 
(Weiss,  1975).  This  can  be  a  handicap  in  modelling,  say,  river-flow  data, 
which  generally  has  quite  marked  directionality  in  its  sample  path  behavior. 
Models  like  the  NEAR(2)  process  for  Exponential  marginals  can  accommodate  a 
wide  variety  of  directionalities,  either  gross  or  subtle,  in  the  sample  path 
behavior.  On  the  other  hand,  the  Beta-Gamma  process  is  time  reversible 
unless  it  is  extended  by  combination  with  the  GAR(1)  process. 

It  is  important  to  note  that  serial  correlations  do  not,  in  any  way,  reflect 
directionality  in  time  series.  This  is  apparent  from  the  well  known  formula 
that  p(r)=p(-r),  r=0, ±, 1 ,+,••• .  This  suggests  using  higher-order  moments  or 
their  transforms,  e.g.  bispectra  (see  for  example,  Rosenblatt,  1980,  1982). 

A  simpler  approach  has  been  suggested  by  Lawrance  and  Lewis  (1985a, 1985b) 
for  processes  which  are  autoregressive  of  order  p,  in  the  sense  that  their 
correlations  satisfy  the  Yule-Walker  equations  (4) .  In  that  case,  the 

linear  autoregressive  residuals 


Vn-1 


a  X  , 
P  n-p* 


n  -  p  +  1 ,  •••, 


(29) 


are  uncorrelated,  although  not  independent  unless  the  residuals  are 

generated  by  a  linear  process.  It  is  this  difference  between  lack  of 

dependence  and  lack  of  correlation  which  is  exploited  in  the  residual 

2 

analysis,  which  consists  of  examining  the  autocorrelations  of  the  R 

2  n 

process,  or  crosscorrelations  between  the  Rn  and  the  R^  process.  This 
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analysis  actually  involves  higher-order  moments  of  the  {XnJ  process,  but 
uses  standard  second-order  statistical  computations. 

An  extension  (Lawrance  and  Lewis,  1985c)  is  to  use  reversed  residuals. 
Thus,  since  the  correlations  for  the  reversed  process  are  the  same  as  for 
the  original  process,  even  if  the  process  is  not  time  reversible,  the 
reversed  residuals 


a1Xn+1 


-  a  X  A  , 
p  n+p’ 


1  ,  ±2 ,  •  •  • , 


will  also  be  uncorrelated.  An  analysis  based  on  both  RR  and  R  is  then 

J  n  n 

possible  to  determine  linearity  and  time-reversibility  in  the  time  series 
and  correctness  of  the  fitted  models. 


CONCLUSIONS 

No  attempt  has  been  made  to  completely  survey  all  the  models  for  continuous 
variate  time  series  which  have  been  proposed.  Instead,  we  have  concentrated 
on  marginally  specific  time  series  models  which  are  simple  in  structure  and 
which  would  be  used  much  in  the  spirit  in  which  Gaussian  linear  models  are 
used  in  the  so-called  Box-Jenkins  method.  For  hydrologic  models  which  are 
physically  motivated,  the  reader  is  referred  to  Lawrance  and  Kottegoda 
(1977)  or  Salas  et  al .  (1980). 
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